Help us grow:) Please share our articles for reach. Nvidia announced a collaboration with Microsoft to build a "massive" cloud computer focused on AI. Their plan is to use tens of thousands of high-end Nvidia GPUs for applications like deep learning and large language models. The companies aim to make it one of the most powerful AI supercomputers in the world. Meanwhile, Microsoft will contribute its Azure cloud infrastructure and ND- and NC-series virtual machines.

Based on Microsoft's Azure cloud infrastructure, the AI supercomputer will use tens of thousands of Nvidia's powerful H100 and A100 data center GPUs and its Quantum-2 InfiniBand networking platform. According to Nvidia, the combination of Microsoft's Azure cloud platform and Nvidia's GPUs, networking, and full AI suite will allow more enterprises to train, deploy, and scale AI -- including large, state-of-the-art models. The two companies will also collaboratively develop DeepSpeed, Microsoft's deep learning optimization software.

Chipmaker Nvidia and Microsoft claim they have built the world's largest artificial intelligence (AI) powered language model to date. The model, called the Megatron-Turing Natural Language Generation (MT-NLP) is a successor to the two companies' earlier work, which gave rise to the Turing NLG 17B and Megatron-LM models. It contains 530 parameters, which the companies claim will bring "unmatched" accuracy when the AI is put to work on natural learning tasks. This includes reading, common sense reasoning, word sense disambiguation and natural language inferences. In comparison to MT-NLP, OpenAI's GPT-3 AI has only 175 billion parameters.